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Thomas M BREUEL et al. Group Art Unit: 2 1 78 
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For: METHOD AND SYSTEM FOR DOCUMENT IMAGE LAYOUT 
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DECLARATION UNDER 37 C.F.R. §1.131 

I, William C. Janssen Jr., a named inventor in the above-identified application, 
hereby declare and state: 

1 . This Declaration is submitted as evidence that the subject matter claimed in 
Claims 1,3-16 and 18-28 of the above-identified application was conceived by the named 
inventors and reduced to practice prior to July 13, 2001, the U.S. filing date of U.S. Patent 
Application Publication No. 2003/0014445 Al (Formanek et al.). 

2. I am a named co-inventor in the above-identified application. 

3 . I have personal knowledge of the function and existence of the computer 
programs, all dated prior to July 13, 2001 , that appear in the directory listing set forth in 
Exhibit A attached to this Declaration. 

4. In the directory listing of the computer programs identified in Exhibit A, 
dates and other material that could indicate dates have been masked out, to the extent 
practicable, as permitted under the U.S. patent rules. 

5. The invention that was reduced to practice in the computer programs 



identified in the directory listing in Exhibit A can be summarized as follows: 

A system and method of converting a document in a page-image format into a 
form suitable for an arbitrarily sized display, the method comprising in sequential order 
the following steps. A document, in a page image format, is deconstructed by at least one 
of physical segmentation and logical segmentation into a set of segmented image 
elements. The deconstructed document is then synthesized into an intermediate data 
structure that is convertible into a commercially available format. The synthesizing 
includes integrating at least one of bitmapped images, including words in reading order, 
in an intelligible display layout and links to non-textual elements. The synthesizing also 
includes converting non-text image areas, layout properties and segmented image areas, 
into the intermediate data structure. The intermediate data structure is (1) capable of 
being stored in a storage device; (2) adaptable to at least one of display screen size, page 
size, resolution, contrast, color and geometry, at the time of display; and (3) adaptability 
supported by at least one of repagination of text, reflowing of text, logical links of text to 
associated text and non-textual content. The intermediate data structure is then distilled 
using commercially available software for redisplay by converting the intermediate data 
structure into a format usable for an arbitrarily sized display. This includes redisplaying 
the document in human readable format to include (1) at least one of an electronic book 
format, Internet browsable format and a print format; or (2) a device specific display 
format. The intermediate data structure is automatically adaptable at the time of display 
to constraints of display devices or circumstances of viewing. 

6. The invention that was reduced to practice in the computer programs 
identified in the directory listing in Exhibit A was conceived prior to July 13, 2001 . This 



invention is claimed in the above-identified application. 



7. 



On August 9, 2006, the inventions represented by the programs listed in 



Exhibit A were used to produce the intermediate format listed in Figure 2 of Exhibit B and 
thereby show the reduction to practice of a system and method of converting a document 
in a page-image format into a form suitable for an arbitrarily sized display as described in 
paragraph 6 herein, in which Figure 1 illustrates a document in a page-image format, Figure 
2 illustrates its intermediate format, Figure 3 illustrates a dynamic reflow of the intermediate 
data format into a first arbitrarily sized display, and Figure 4 illustrates a dynamic reflow of 
the intermediate format into a second arbitrarily sized display. 

8. I hereby declare that all statements made herein of my own knowledge are 
true, and that all statements made on information and belief are believed to be true; and 
further that these statements were made with the knowledge that willful false statements 
and the like so made are punishable by fine and/or imprisonment under Section 1001 of 
Title 18 of the United States Code, and that such willful false statements may jeopardize 
the validity of the application or any patent issuing therefrom. 
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Real-Time Control of a Virtual Human Using Minimal Sensors 
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1 Abstract 

We track, in real-time, the position and posture of a 
human body, using a minimal number of 6 DOP sen- 
sors to capture full body standing postures. We use 
4 sensors to create a good approximation of a human 
operator's position and posture, and map it on to our 
articulated computer graphics human model. The 
unsensed joints are positioned by a fast inverse kine- 
matics algorithm. Our goal is to realistically recreate 
human postures while minimally encumbering the op- 
erator. 



2 Background 

Ideally, a virtual environment interface should be able 
to measure and recreate a participant's posture exact- 
ly. Rather than the traditional "disembodied hand" 
approach, we would like to generate a complete, real- 
istically postured human image. However, the equip- 
ment needed to accurately track every body segment 
(or joint angle) of a human is costly and cumbersome. 
We face several questions: how closely must the vir- 
tual human's posture match the operator's, and how 
much information do we need to achieve this degree 
of realism? 

As in other areas of VR, the degree of realism nec- 
essary depends greatly on the tasks we would like 
to perform [11]. We have concentrated on creating 
an interface that will allow a human participant to 

perform basic tasks, using a minimal number of sen- Figure 1: Sensor Placement and Support Polygon 
aors to derive feasible, reasonably accurate postures. 
Three pieces of information are essential for our pos- 
ture reconstruction algorithm: the participant's view 
vector, center of mass, and the location of the end- 
effector* the participant will use to interact with the 
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19104 - 6389 1 Abstract W e track, in real - 
time, t he position and posture of a human body, 
using a minimal number of 6 D OF sen sors to 
capture f idl body standing postures. W e use 4 
sensors to create a good approximation of a 
human operator s position and posture, and map it 
on to our articulated computer graphics human 
model. The unsensed joints are positioned by a f 
ast inverse kine - matics algorithm. Our goal is to 
realistically recreate human postuires while 



■' ; Dontfc£ 



